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Abstract 


As America’s public school population becomes more diverse, selecting culturally appropriate instructional 
materials becomes increasingly important. Though several existing scales assess the quality of curricula materials, 
most do not consider cultural relevance. The Curricula Appropriateness Scale (CAS) was designed to determine the 
appropriateness of curriculum materials for diverse populations. The final CAS contains six statements with a 
4-point, Likert-type scale response option ranging from ]=strongly disagree to 4=strongly agree /or each item. 
Item selection was based on a review of the professional literature and existing instruments. A local panel of experts 
(n=10) examined a draft version of the scale for content validity. Based on the panelists’ comments, the scale was 
revised and piloted with 27 undergraduates enrolled in an elementary school health course. A national panel of 
experts (n=5) then examined the scale for content validity. Feedback from the national panel was used to revise the 
CAS for a second pilot test. Students enrolled in a second elementary school health course completed the second CAS 
during the assessment of the federally developed curriculum, Learning to Live Drug Free. Item consistency 
reliability was measured using Cronbach’s alpha. Psychometric characteristics and recommendations for using the 
CAS are presented. 


According to Census 2000 data, America 
is becoming more racially diverse (U.S. 
Census, 2001). Among the 274.6 million 
people identifying themselves as belonging 
to only one race, nearly 1 in 4 (24.9%) were 
non-White. The U.S. population includes 
28.4 million (or about 1 in 10) foreign-born 
residents (U.S. Census, 2000). Moreover, 
about 13% of the total population were 
Hispanic or Latino. Additionally, 6.8 mil- 
lion people reported belonging to more 
than one race (U.S. Census, 2001). 

Enrollment in U.S. public schools re- 
flects the country’s growing diversity. As a 
result, schools are increasingly challenged 
to understand and deliver an educational 
experience that meets the cultural needs of 
a diverse study body. Thus, the issue of cul- 
tural competence becomes more important 
for schools (Banks, 1995). People who are 
culturally competent have a broad outlook 
of the world (Powell, 1997). This ability, 
which holds the potential to alter negative 


and stereotypical thinking, can reduce in- 
tolerance, increase respect, and promote 
cooperation among individuals from di- 
verse backgrounds. By exposing students to 
unfamiliar cultures, teachers lead students 
to discover a world rich with ideas, tradi- 
tions, morals, beliefs, and values that ex- 
pand both the students’ and educators’ un- 
derstanding of the human condition 
(Sanchez, 1996). 

Culturally appropriate curricula help to 
maintain academic integrity so diverse com- 
ponents of society can learn to understand 
and respect each other (Lawrence, 1997). 
Transforming curricula for an ethnically 
diverse society requires thoughtful delibera- 
tion on all aspects of school practice, includ- 
ing how schools influence student percep- 
tions and responses within and outside of 
school. Banks (1995) described content 
integration as a necessary component in 
culturally appropriate education. This pro- 
cess includes teachers using examples and 


content from a variety of cultures and shared 
attributes of subgroups within the broad 
racial categories to illustrate key concepts, 
principles, generalizations, and theories in 
their subject areas. A culturally appropriate 
curriculum includes segments of the popu- 
lation that compose our “national identity” 
(Lawrence, 1997). 

Because of the growing diversity in 
public schools, educators must ensure that 
curricula appeal to a diverse student popu- 
lation and determine whether curricula are 
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being effectively implemented. Local school 
boards generally decide what curricula best 
meet the needs of students. Individuals 
responsible for assessing curricula should 
consider many different cultural heritages. 
One vital component of implementing a 
curriculum includes instructional materi- 
als that provide diverse but accurate per- 
spectives (Sanchez, 1996). Textbooks pro- 
vide most of the content in the teaching/ 
learning process (Sewall, 1987). Textbook 
bias appears in several contexts including 
stereotyping, omissions, distortions, and 
biased language. Educators must evaluate 
these resources in terms of content, lan- 
guage, and illustrations (Sanchez, 1996). 

One barrier to providing culturally ap- 
propriate education is the lack of culturally 
competent educators who know how to 
develop or select culturally appropriate cur- 
ricula and instructional materials. Though 
several curricula assessment tools exist, 
none appear to assess the cultural appro- 
priateness for diverse populations (Hollins, 
1996). This project developed a tool, the 
Curriculum Appropriateness Scale (CAS), 
to assess curricula for cultural appropriate- 
ness (Figure 1). CAS may help improve the 
process of selecting curricula that is con- 
sistent with basic skills and cultural com- 
petence. CAS also can be used to assess 
K-12 curricula to determine if the material 
is culturally appropriate. Moreover, CAS 
can be added to the Instrument for Curricu- 
lum Evaluation (ICE) (Benson, Doidge, & 
Riley, 1988), which served as a framework 
for the present scale. Though ICE was 
developed to assess various aspects of cur- 
ricula materials, it does not contain a 
section on cultural appropriateness. By 
adding CAS to ICE, people responsible for 
modifying or selecting curricula can be 
reasonably sure that ethnic cultures are 
accurately represented. 

INSTRUMENT DEVELOPMENT 
PROCESS 

Instrumentation 

Though it can be used as a stand-alone 
tool, CAS was designed to serve as an 
addendum to ICE, which was developed by 


Benson, Doidge, and Riley (1988). ICE was 
designed originally to assess the quality 
of curricula and instructional materials 
using 59 criteria distributed across 14 
focus areas (McDermott & Sarvela, 1999). 
Yet ICE does not include a section on cul- 
tural appropriateness. 

The selection of the seven items was 
based on a review of the literature concern- 
ing cultural competence (Airhihenbuwa & 
Pineiro, 1988; Association for the Advance- 
ment of Health Education, 1994; Banks, 
1995; Office of Substance Abuse Prevention, 
1992; Powell, 1997; Sanchez, 1996), previ- 
ous scales published in cultural competence 
evaluation text (Acosta-Deprez & Monroe, 
1996; Powell, 1997; Reeves, 1997), two 
pilot tests, and two expert panel reviews. Af- 
ter writing each of the original 58 items on 
individual index cards, the items were 
sorted for redundancy. Redundant cards 
were eliminated, as were unclear cards and 
those that did not pertain to the assessment 
of cultural appropriateness. Twelve poten- 
tial items were chosen from the original 
pool of 58 items. In terms of scale specifi- 
cation, there is a 4-point agreement scale 
with response options from \=strongly 
disagree to 4=strongly agree. 

Content Validity and Expert Panel 
Review 

During spring 1999 a 12 -item prelimi- 
nary draft of the instrument was evaluated 
for content validity by a local panel of 
experts comprised of 10 faculty members 
at a large “Research I” university. Panel 
members had expertise in research, evalua- 
tion, and health education. The panel sug- 
gested improvements in phraseology and 
recommended reducing the scale from 12 
to 10 items. A preliminary pilot study of the 
revised instrument was conducted with 27 
students enrolled in an elementary school 
health course. The instrument was revised 
again based on results from the preliminary 
pilot study. Then the final revision of the 
instrument was submitted to a national 
panel of experts. 

In spring 2000, 15 nationally recognized 
individuals were invited to review the scale 
before the final pilot test. These individuals 


were identified based on their expertise in 
health education, multicultural education, 
research, and curriculum. Of 15 experts 
invited, 9 agreed to participate. The 9 
experts each were mailed an assessment 
packet containing a cover letter, the scale, 
instructions, and the assessment form to be 
completed. The assessment form evaluated 
four areas; focus, brevity, clarity, and read- 
ability. Based on these criteria, experts as- 
sessed the purpose, directions, response 
options, and each question individually. The 
overall scale was assessed for content valid- 
ity as well. Experts also were encouraged to 
write comments directly on the scale itself. 
Five of nine experts returned the completed 
assessment form and scale to be included 
in the revision process. Recommendations 
from the national panel were used to revise 
the CAS for a final pilot test. Revisions 
included reducing the scale from 10 to 7 
items with wording modifications. 

Pilot Tests 

The preliminary pilot test was conducted 
in spring 1999. Students at a large Research 
I university enrolled in an elementary 
school health program course during the 
1999 spring semester were invited to par- 
ticipate. Students were offered two extra- 
credit points from their instructor for par- 
ticipating. Researchers explained the 
purpose and procedures of the study to the 
class of 105 students. Students were asked 
to evaluate a brief tobacco curriculum us- 
ing the initial 10-statement CAS. Research- 
ers offered three different meeting times on 
different days to the students at the univer- 
sity library. The researchers proctored each 
session. Twenty-seven students participated 
in the preliminary pilot test. 

The final pilot test was conducted in 
summer 2000. Students enrolled in the 
summer semester of an elementary school 
health program course participated in the 
final pilot test. For the final pilot test 
the instructor agreed to include pilot test 
activities as a class assignment for all 
students. The assignment was included in 
the course syllabus. 

The final pilot test included evaluating 
a curriculum using ICE and CAS. The 
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Figure 1 . Curricula Appropriateness Scale 


Purpose; This tool can be used to help determine whether health education curricula and program resources are culturally 
appropriate given an intended audience. 

Directions: Please circle the number that matches your response to each statement using the scale below as your guide. 


1 =SD=Strongly Disagree 2=D=Disagree 3=A=Agree 4=SA=Strongly Agree 


1 . Ethnic minorities are positively represented 
in a variety of roles 

2. Insensitive language and vocabulary toward 
ethnic minorities are used 

3. Negative stereotypes are assigned to ethnic 
minorities 

4. Materials include participation of various ethnic 
groups 

5. Materials contain negative ethnic bias 

6. Materials promote respect for ethnic differences 


SD D A 


2 3 


2 3 


2 3 


2 

2 

2 


3 

3 

3 


Reverse score items 2, 3, and 5. Add all responses. 

Scores 1 8 and above suggest materials lean toward being culturally appropriate. 


SA 

4 

4 

4 

4 

4 

4 


NA 

NA 

NA 

NA 

NA 

NA 

NA 


Learning to Live Drug Free curriculum, 
developed by the U.S. Department of Edu- 
cation (1992), was the curriculum selected 
for review. Learning to Live Drug Free was 
selected for the final pilot study because the 
researchers needed sufficient copies of an 
inexpensive, weU-designed, self-contained 
curriculum. Also, because the curriculum 
was developed and distributed under the 
auspices of the U.S. Department of Educa- 
tion, the researchers made the inference that 
for the purpose of this preliminary investi- 
gation the curriculum was of acceptable 
quality in terms of content accuracy, 
authority, objectivity, and coverage. Stu- 
dents were asked to review the curriculum 
using both ICE and CAS at different times. 
On the first day of the final pilot test the 
researcher introduced the first part of the 
assignment for assessing the Learning to Live 
Drug Free curriculum using ICE. Students 
were given 2 days to complete the assign- 
ment. Students were encouraged to consider 
the curriculum’s value and whether they 
would recommend the curriculum to oth- 
ers or use it themselves in their own class- 
rooms. Each student received a copy of the 


Learning to Live Drug Free curriculum and 
ICE. Students were told they could keep the 
curriculum after the assignment was com- 
pleted. Students were encouraged to high- 
light, underline, and make notes on the 
curriculum. Also, they were asked to bring 
the curriculum, with the completed ICE, to 
the next class for an in-class activity, the 
second part of the final pilot test. 

Two days after the initial assignment, the 
second part of the final pilot test was con- 
ducted. First, students were given 10 min- 
utes to review the Learning to Live Drug Free 
curriculum within the context of the find- 
ings from their assessment using the ICE 
scale. This step was designed to prepare stu- 
dents for the assessment using CAS. Next 
the researchers collected the completed ICE 
assessments. Then students were informed 
they would be completing another scale to 
assess the curriculum for cultural appropri- 
ateness. CAS was distributed and completed 
during class time. Of the 81 students en- 
rolled in the class, 71 participated in both 
assessment activities. 

Readability 

The SMOG reading formula was used to 


assess readability. This formula was chosen 
for its simplicity and because it requires 
100% comprehension of the material read, 
thus producing conservative estimates 
(Windsor, Baranowski, Clark, & Cutter, 
1984). The SMOG procedure produced a 
readability estimate of 12.0 on the final scale, 
indicating an approximate reading level of 
grade 12. This level of reading is appropri- 
ate, considering the intended audience has 
an education level above grade 12. 

PSYCHOMETRIC CHARACTERISTICS 

Descriptive Statistics 

The descriptive data, based on a maxi- 
mum score of 28, revealed a mean score of 
19.98 (SD=2.39). With a minimum score of 
16 and a maximum score of 25, the range 
was 9. Among the seven scale items, vocabu- 
lary (Q2) and stereotypes (Q3) scored the 
highest (M=3.24, SD=.44 and M=3.24, 
SD=.49, respectively) and roles (Ql) scored 
the lowest {M-2A9, SD=.60). 

Scale Reliability 

Internal consistency reliability for the 
scale was assessed by calculating coefficient 
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Table 1 . Scale Psychometrics; Score Direction, Means, Standard Deviations, Item-to-Total 
Correlations, and Coefficient Alpha Reliability Estimates 

Item 

SD" 

M 

SD 

ITC" 

AWID’' 

1 . Ethnic minorities are positively represented 
in a variety of roles 

P 

2.49 

.597 

.697 

.668 

2. Insensitive language and vocabulary toward 
ethnic minorities are used 

N 

3.24 

.435 

.471 

.728 

3. Negative stereotypes are assigned to ethnic minorities 

N 

3.24 

.489 

.556 

.709 

4. Materials include participation of various ethnic groups 

P 

2.63 

.536 

.445 

.731 

5. Materials contain negative ethnic bias 

N 

3.14 

.527 

.425 

.735 

6. Materials promote respect for ethnic differences 

P 

2.15 

.597 

.498 

.719 

7. Contributions and skills of people from various 
ethnic backgrounds are presented 

P 

2.71 

.559 

.249 

.773 

Note: Standardized sample, N=41. 
*AWID=alpha with item deleted. 
®SD=score direction. 
''ITC=item-to-total correlation. 


alpha (Cronbach, 1951). This approach 
measures item consistency reliability; the 
extent to which all items relate to one an- 
other (McDermott & Sarvela, 1999). The 
reliability estimate for the scale was .76, 
which is within acceptable range for applied 
research (Nunnally, 1978). Interrater reli- 
ability was assessed by transposing the vari- 
ables and computing coefficient alpha. The 
interrater reliability estimated for the scale 
was .96, revealing an overall high degree of 
consistency among raters on the items com- 
prising the scale. 

Item Analysis 

Table 1 shows score direction (negative 
or positive), means, standard deviations, 
individual item-to-total correlations, and 
alpha coefficients with item deleted. Item 
means ranged from 2.15 to 3.24, item 
standard deviations ranged from .435 to 
.597, and item-to-total correlations ranged 
from .249 to .697. Alpha coefficients with 
items deleted from the scale ranged from 
.71 to .77. Interitem correlations for indi- 
vidual items were between -0.1 1 and .77 as 
measured by Pearson’s product moment 


correlation coefficient. Item 7 was nega- 
tively correlated with three items; 2, 3, and 
5. The remaining 18 correlations were 
positive. Deleting Item 7 did not increase 
coefficient alpha for the scale, although it 
did eliminate all negative interitem corre- 
lation coefficients. 

DISCUSSION 

CAS was designed to assess the cultural 
appropriateness of curricula, educational 
modules, and instructional materials such 
as videos. Because of its low item-to-total 
correlation and the fact that it negatively 
correlated with three items. Item 7 (Table 
1 ) should be deleted. Additional pilot stud- 
ies that include practitioners experienced 
in curricula evaluation might reveal pos- 
sible areas for improvement. In any case, a 
revised scale is presented in Figure 1. 

Data from the pilot study indicated that 
CAS is reliable from the internal-consis- 
tency perspective. Moreover, based on the 
careful examination of two expert panels, 
it may be concluded that CAS is content 
valid for assessing the cultural appropriate- 


ness of health education curricula. However, 
several limitations of this study should 
be noted. First, the participants in this 
study were not experts in curriculum, sub- 
stance abuse prevention education, or 
multicultural education. Second, because 
the final pilot study was conducted in a 
classroom environment, “student-raters” 
may have responded in a socially desirable 
manner, creating a potential response bias. 
Third, the pilot test was conducted with 
only one curriculum. Thus, subsequent 
studies using expert panels and multiple 
curricula would increase the generalized 
application of the scale. Fourth, because a 
rating scale reflects the judgments of hu- 
man recorders whose perceptions are sub- 
ject to influences, the scale itself may reveal 
inconsistencies or errors (Tuckman, 1999). 
Although rating scales offer an efficient re- 
cording technique, the results they produce 
are subject to human error. 

CAS appears to have at least four appli- 
cations. First, the scale can be used to assess 
the cultural appropriateness of curricula, 
educational modules, and instructional 
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materials designed for priority or general 
populations being considered for adoption. 
On this 24-point scale, a score of 18 or above 
suggests materials lean toward being cultur- 
ally appropriate. A score of 18 is equivalent 
to a mean score of 3.0 (i.e., agree or strongly 
agree). CAS can be used alone, or it can be 
added to the Instrument for Curriculum 
Education. (Benson et ah, 1988). Second, 
CAS can help identify deficiencies in cur- 
ricula, educational modules, and instruc- 
tional materials currently being used in 
school and nonschool programs. Third, 
CAS can be used as a guide for designing 
culturally appropriate materials. Fourth, the 
scale can be used as a resource for teaching 
elementary majors and health education 
majors how to assess and develop cultur- 
ally appropriate materials. 

For educators and education majors, 
health teachers and health educators, the 
use of a curriculum assessment tool that 
includes a section on cultural diversity will 
lead to a more positive learning environ- 
ment for students of all backgrounds. It will 
provide a means for educators to determine 
whether a curriculum is culturally appro- 
priate for their students. Future assessments 
focusing on ethnic diversity will foster 
appreciation for diversity both in and out 
of the classroom. 

Cultural competence specialists empha- 
size that to have integrity in education, the 
learning experience must begin with the 
proposition that all humans have contrib- 
uted to world development and the flow of 
knowledge and information, and that most 
human accomplishments are the result of 
mutually interactive, international efforts. 
“Without multicultural education, students 
remain essentially ignorant of the contri- 
butions of a major portion of the world’s 
people” (Asante, 1991, p. 172). 

Some of the goals that are found 
frequenty in a diversified curriculum 


include helping students recognize and 
understand the values and experiences of 
one’s own ethnic/cultural heritage; promot- 
ing sensitivity to diverse ethnicities/cultures 
through exposure to other cultural perspec- 
tives; developing an awareness and respect 
for the similarities and differences among 
diverse groups; and identifying, challeng- 
ing, and dispelling ethnic/cultural stereo- 
typing, prejudice, and discrimination in 
behavior, textbooks, and other instructional 
materials (Sanchez, 1996). Through contin- 
ued development and evaluation of cur- 
ricula materials for diverse populations, 
educators can strive toward achieving these 
goals necessary for an increasingly diversi- 
fied society. 
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